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Abstract. We provide an exact expression of the moment of the partition function 
for random energy models of finite system size, generalizing an earlier expression for a 
grand canonical version of the discrete random energy model presented by the authors 
in Prog. Theor. Phys. Ill, 661 (2004). The expression can be handled both 
analytically and numerically, which is useful for examining how the analyticity of the 
moment with respect to the replica numbers, which play the role of powers of the 
moment, can be broken in the thermodynamic limit. A comparison with a replica 
method analysis indicates that the analyticity breaking can be regarded as the origin 
of the one-step replica symmetry breaking. The validity of the expression is also 
confirmed by numerical methods for finite systems. 
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1. Introduction 

The replica metliod (RM) is one of the few analytical techniques available for dealing 
with disordered systems [HIS]. In general, RM can be regarded as a scheme for evaluating 
the generating function 

Mn) = ^\og{Z-), (1) 

for real number n G M (or complex C), where Z and (■ ■ ■) represent the partition 
function and the average over the quenched randomness that governs the objective 
system, respectively. Unfortunately, direct evaluation of eq. ([T]) is difficult in general. 
In statistical mechanics, the system size N is in most cases assumed to be infinitely 
large, which often makes the analysis possible for n = 1, 2, . . . G N. Therefore, RM in 
statistical mechanics usually first evaluates eq. ([I]) for n G N in the limit ^ oo as 

0(n) = lim (f)N{n), (2) 

N—*(xy 

and then analytically continue the expression from n G N to n G M. 

This procedure generally includes at least two mathematical problems, although 
it was recently proved for several examples that the solutions obtained by RM are 
mathematically correct [3],ll]. The first problem concerns the uniqueness of the analytic 
continuation from n G N to n G M. Even if all values of </'Ar(n) are provided for 
n = 1, 2, . . ., in general, it is not possible to determine the analytical continuation from 
n G N to n G M (or C) uniquely. Carlson's theorem guarantees that the continuation in 



l/N 



is upper-bounded 



the right half complex plane is unique if the growth rate of 

by ©(e'^'"') [5]. However, this sufficient condition is not satisfied even in the case of the 
famous Sherrington-Kirkpatrick (SK) model that describes a fully connected Ising spin 
glass system [6], for which (Z")"*^^^ scales as 0(e*"'"'^), where C is a certain constant, 
van Hemmen and Palmer conjectured that this might be related to the failure of the 
replica symmetric (RS) solution of the SK model at low temperatures, although further 
exploration in this direction is difficult [7j. 

The second issue is the possible breaking of the analyticity of 0(n). Even if the 
uniqueness of the analytic continuation from n G N to n G M (or C) is guaranteed for 
0Ar(n) of finite N, the analyticity of 0(n) = lim^v^oo 4'N{n) can be broken. This implies 
that if the analyticity breaking occurs at a certain point n = Uc < 1, the analytically 
continued expression based on (j){n) will lead to an incorrect solution for n < Uc- In an 
earlier study, the authors developed an exact expression of (Z") for a grand canonical 
version of the discrete random energy model (GCDREM) [8], [9] of finite system size 
[To] . The expression indicates that the speculated scenario does occur in this model as 
N ^ oo. In addition, the model satisfies the sufficient condition of Carlson's theorem, 
guaranteeing the uniqueness of the analytical continuation for finite A^. These points 
imply that the analyticity breaking with respect to the replica number n is the origin 
of the one-step replica symmetry breaking (IRSB) observed in GCDREM. However, 
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as GCDREM is a relatively unfamiliar model, the obtained result may be regarded as 
anomalistic and therefore might be taken as being less significant. 

The purpose of this paper is to address this view. More precisely, we develop an 
exact expression of (2'") that is applicable to generic random energy models (REMs) 
[11] of finite system size. The expression, which is a generalization of that developed 
for GCDREM, indicates that analyticity breaking with respect to the replica number 
occurs in standard REMs as well and is the origin of IRSB. 

This paper is organized as follows. In the next section, we introduce the model. In 
order to guarantee the uniqueness of analytical continuation, we will mainly consider the 
canonical version of the discrete random energy model (CDREM). However, a similar 
approach is also applicable for standard continuous REM, although the uniqueness 
of the analytical continuation from n G N to n G C is not guaranteed by Carlson's 



theorem. This is shown in Appendix A In section 3, the main part of the paper, an 
exact expression of (Z^) is developed. In section 4, the developed expression is used 
to examine how the analyticity of (Z") can be broken as ^ oo. The utility of the 
expression for assessing the moment of REMs of finite size is also shown. The final 
section is devoted to a summary. 

2. Model definition 

The canonical discrete random energy model (CDREM), which we will focus on here, is 
defined as follows. Suppose that A^ and M are natural numbers where a = M/N. The 
energy for each of 2^ states A = 1,2, ... ,2^ is determined as an independent sample 
from an identical distribution 

^(^) - ( iM ' e)- 

where E is limited to —M/2, —M/2 + 1, . . . , M/2. We denote a set of sampled energy 
values as {ca}- For each realization of {e^i}, the partition function is defined as 

2JV 

Z= ^exp(-/?eA), (4) 

A=l 

where /3 = > denotes the inverse temperature. Our main objective is to develop 
an expression of (^"), the evaluation of which is computationally feasible for VA^, VM 
and Vn G C, where (■■■), in this case, represents the average with respect to {e^}- 

Before proceeding further, it is worth explaining why this model has been selected. 
A distinctive property of this model is that the possible energy values are lower-bounded 
by —M/2, which makes it possible to upper-bound the absolute value of a modified 
moment as 

Re(ri) 
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for any finite A^. Consider an analytic function \l/(n;A^) which satisfies the condition 
|^(n; N)\ < 0(e^l"l)- Carlson's theorem ensures that if ^(n; A^) - ( (e-^^/^^)")^^^ = 

holds for n = 0, 1, 2 . . ., ^(n; N) is identical to ( (e'^^^/^^)") ' over the right half 
complex plane of n. The identity for n = trivially holds if \E'(0;A^) = 1. Since 
g-/3M/2 -g non- vanishing constant and ( (e~^*^''^Z)")"'^ is a single- valued function, 
this implies that the analytical continuation of (^Z^)^^^ from n = 1, 2, . . . to n G C is 
uniquely determined in this model as long as is finite. This property is useful for 
examining intrinsic mathematical problems of RM because we can exclude the possibility 
of multiple analytical continuations when certain anomalous behavior is observed for 
(Z^). This is the main reason why we have selected CDREM as the objective system 
in the current paper. 

The technique developed in the next section is also applicable to generic REMs, as 
shown in Appendix A Unfortunately, we cannot use Carlson's theorem for guaranteeing 
the uniqueness of the analytical continuation for the original continuous REM [TT] , since 



is not upper-bounded by e'^'"'. However, the analysis in Appendix A indicates 
that the behavior of the continuous REM in the thermodynamic limit is qualitatively 
the same as that of CDREM; in both systems, for n = 1,2,... is described 

by either of two replica symmetric solutions one of which is proportional to n while 
the other is nonlinear with respect to n, and the replica symmetry breaking solution 
bifurcates from the nonlinear solution at a certain critical number < Uc < 1 for n < Uc 
when the temperature is sufficiently low. This implies that, for a wide class of random 
energy models, the origin of replica symmetry breaking is not the multiple possibilities of 
analytical continuation but the analyticity breaking with respect to the replica number 
that occurs in the thermodynamic limit. 



3. Exact expression of (Z") 

The expression of the partition function 

2'^ M M 

A=l i=0 i=0 

is the basis of our analysis, where rii (i = 0, 1, . . . , M) represents the number of states 
with energy E = i — M/2. A remarkable property of DREM is that the probability 
distribution of {rij} has a feasible form as a multinomial distribution 
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where Sm,n = 1 ii m = n and otherwise. This makes it possible to assess the moments 
(Z") directly from {rii} without referring to the full energy configuration {e^}, yielding 



oo oo 



710=0 711=0 nj^i=0 
oo oo oo 



= E E ■ ■ ■ E {PiEo)rnp{Ei)r ■ ■ ■ {PiEM)r 

710=0 711=0 nM=0 

2iv, 

Two identities are useful for evaluating eq. ([8]): 

^n^JH^ (c> 0,f(n) = -2isinn7rr(n)), (9) 

r(-n) 

and 

A -± 
2m 



z'^-^'-'dz, (10) 



where i = v^— 1. In eq. (Q, T{z) = i/(2sinz7r) j^{—pY~^e~''dp represents the Gamma 
function and the integration contour H is provided as shown in figure [H The integration 
contour of eq. (fTOl) is a single closed loop surrounding the origin. Inserting eqs. ([9]) and 
(fTOl) into eq. (IHD yields 

oo oo oo 

(^") = E E ■ ■ ■ E {PiEo)r{PiEi)r ■ ■ ■ {PiEM)r , " , 

no=Oni=0 nM=0 ^ 



' J dpi- py-^e-'-'^" ^Jdzz"^"' 



,ni-2~-l 



\ni=0 / \nM=0 



T{-n)JH 27ri 
Finally, applying the residue theorem to the integration with respect to z, we obtain 



nM / M ^ 



= / dpi-p)—' {J2PiE,)e-''' ] , (12) 

r(-^) Jh Vt^ / 

which exactly holds for any complex value of n. This is the main result of this paper. 

Several points are noteworthy here. The first issue is a relation to an earlier study. 
In ref. [12], Gardner and Derrida provided an expression somewhat similar to eq. f|T2l) 
for non-integer moments of the partition function of the continuous REM. Actually, 
the present expression of eq. (fT2!) can be regarded as a generalization of eq. (7) of 
ref. [12], for which, however, tractability for finite N is not emphasized. The link of 
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m (p) 



Figure 1. Integration contour. 



H Re(p) 



the two expressions is shown in Appendix A The second is the computational cost for 
evaluating eq. (IT^ . For each p G C, the integrand of eq. (IT^ can be evaluated with 
0{N) computations provided a = M/N ~ 0(1). On the other hand, the length of 
the integration contour H is infinite, which may seem an obstacle for the numerical 
evaluation. However, for relatively large A^, the integrand rapidly vanishes on the 
contour if as |p| — oo, guaranteeing that numerical deviation is practically negligible 
even if we approximate if by a path of a finite length. Therefore, eq. ( JT2l) can be 
evaluated with a feasible computational cost. The third point is the similarity to an 
approach in information theory sometimes termed the method of types [13]. In this 
method, the performance of various codes consisting of exponentially many codewords 
is evaluated by classifying possible events when the codes are randomly generated by 
varieties of empirical distributions, termed types. The key to this method is accounting 
for the fact that the number of types grows only polynomially with respect to the code 
length while the number of the codewords increases exponentially. As a consequence, the 
relative weight of the types concentrates at a certain typical value at an exponentially 
fast rate, which considerably simplifies the performance analysis. In the current case, the 
set of occupation numbers {rii} is analogous to the types in information theory. However, 
in spite of this analogy, objective quantities are usually evaluated by upper- and lower- 
bounding schemes in information theory. Therefore, the technique developed in the 
present paper may serve as a novel scheme for analyzing various codes in information 
theory. The final issue relates to the relationship to a model examined in an earlier 
study. In ref. [1^, the authors offered a formula similar to eq. ( fT2l) for a grand 
canonical version of the discrete random energy model (GCDREM). Unlike CDREM, 
GCDREM is defined by independently generating the occupation number of each 
energy level from the beginning. In the present framework, this can be characterized by 
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a factorizable distribution of {rii}, 



M 



P(M) = e-^'Tl '"'''!f"^ ' • (13) 



which offers a feasible expression 



nM M 

in = 1^ / dp{-p)—' exp [- 5^(1 - e->)P(i?,)2^]. (14) 
Ti-n) Jh ^ 

This is the counterpart of eq. ( fT2|) . Since the distributions of rii are independent, the 
derivation of eq. (HM is easier than that of eq. ( |T2|) . In GCDREM, the total number of 
states J\f = ^*1q ni fluctuates from sample to sample as rii is independently generated 
at each energy level. The ratio between its standard deviation and expectation vanishes 
as 2~^/^ and therefore the effect of the statistical fluctuation is practically negligible 
when is reasonably large. Nevertheless, eq. ( fT3l) implies that an ill-posed sample 
Ui = {i = 0,1, ... , M) can be generated with a probability 2~^, which is not adequate 
for representing REMs of small system size. Therefore, the development of eq. (fT2ll 
beyond eq. iHM is important for REMs of finite size. 

4. Applications 

In this section, we demonstrate the utihty of the developed expression (|T2|) by 
considering two applications. 

Thermodynamic limit and breaking of analyticity 
RM indicates that CDREM exhibits the following behavior in the thermodynamic limit 



N,M ^ oo keeping a = M/N finite. For details, see Appendix B 
Under the RS ansatz, RM yields two solutions 

0RSiH = n |^log2 + alog |^cosh (^^^^ ' (15) 

and 

0RS2(?^) = log 2 + a log l^cosh ^ • (16) 

For Va and V/3, these solutions agree at n = 1. Let us denote a critical inverse 
temperature as 

/? = I " - ^ (17) 

\ log (1 - h,\l - a-')) - log {h^\l - a-')) , a > 1 ' ^ 

where h2^{y) is the inverse function of the binary entropy h2{x) = — 2;log2(l — a;) — 
(1 — x) log2(l — a;) for < a; < 1/2. For (3 < (3c, (pin) can be described by 0rsi(^) and 
0RS2(^)- More precisely, there exists 3?t,rs > 1 such that (piji) = 4>RS2{n) for n > n^g 
and 0(n) = 0rsi(?^) for n < nRs. On the other hand, for /? > Pc, (piji) cannot be 
entirely covered by the RS solutions. In this "low temperature" phase, 0(n) = 0rs2('^) 
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holds for n > Uc = jSc/ (3. However, this solution becomes inadequate for n < since 
the convexity condition (d/dn) (^~^0rs2('t-)) > is not satisfied. Therefore, we have 
to construct a novel solution for n < Uc taking the breaking of replica symmetry into 
account, which provides the IRSB solution 

0irsbN = tanhy. (18) 

The behavior of 0(n) is shown in figure [2l 

As long as N is finite, (f)N{n) is generally analytic with respect to n and Carlson's 
theorem guarantees the uniqueness of the analytical continuation from n G N to n G C 
for 0Ar(?7.) of CDREM. This implies that the transitions between multiple solutions 
mentioned above are highly likely to be due to the breaking of analyticity that possibly 
occurs in the limit 0(n) = limTv^oo 0Af(^)- The expression of eq. (fT2l) can be used to 
examine the origin of such potential analyticity breaking. 

We here focus on the breaking for the transition between 0rs2(^) and 0irsb('^), 
which can be regarded as the origin of IRSB. For this purpose, we assume a > 1 and 
(3 > Pc, and consider only the region < 1 in which = (3c/ (3 < 1 is included. Under 
such conditions, integration by parts transforms eq. (fT2!) to 

= -^-^ / dp{-p)-g{p)f{p), (19) 
ni {—nj Jh 

where 

nJV 1 

/ M \ 



and 



M 



g{p) = J2P{E.We-'^''. (21) 

Next, we deform the contour H to a set of straight lines along the real half axis as 
if : cxD + ie — > +ie —>■ — ie — > oo — ie, where e is an infinitesimal number. Since the 
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contribution around the origin vanishes for Re(n) < 1, only the contribution due to the 
difference between the branches of p~" remains as 

= ^T^f^^ dpp-g{p)f{p). (22) 

Note that the function T{z) is replaced with the ordinary gamma function T{z) in this 
expression due to the difference between the two branches. We now evaluate eq. ( l22l) . 
converting the relevant variables as 

which is useful for taking the thermodynamic limit N, M —>■ oo keeping a = M/N finite. 
This yields an expression of the moment 

r(l-n) 

The analysis shown below indicates that a (x — 1/2) and (y{y — 1/2) can be interpreted 
as possible values of energy density N~^Ei and free energy density —{N [3)~^\ogZ , 
respectively. 

An asymptotic form of the double exponential function for ^ 1 

e-^^"""- (l-e-^")e(M), (25) 

where Q{u) = 1 for m > and otherwise, plays a key role for assessing eq. fl24p in the 
thermodynamic limit. We first evaluate the asymptotic expression of /(e^"'^^) using 
this formula. Eq. fl25l) . in conjunction with an assessment by the saddle point method, 
yields 

M „i 
1^ ^ 



Jo 

1 _ giVa(log(l+c<;)+/3»/-log2)^ y ^ 

1 - e^"('^(^-)-iog2)^ Xc<y< 1/2, (26) 

0, 1/2 < y, 

where Xc = e~^/(l + e~^) < 1/2 and h{x) = —xlogx— (1 — x) log (1 — x). Therefore, 
/(e^"^^) can be evaluated as 



where 



, , , 11 - a) \og2 + ah{P) + apy, y < x^, 

^ [l-a)\og2 + ah{y), < y < 1. ^ ' 

Here, h{(3) represents the Legendre transformation of the function h{x) as h{f3) = 

log (2 cosh (/3/2)) — P/2 = log(l + u;). These indicate that in the limit — cxd eq. 
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(|27|) can be reduced to the expression 

f^e'^'^Py) ~ (1 - e^^(^)) e{x* -y) ^e{x* -y), (29) 
where x* = /ig ^ (1 — a^^) = e'^" /{I + e"^"). Similarly, g(e^°'^'^) can be evaluated as 

^(e^"^^) ~ 2-^e^(-'^^^+-^(^))e(l - y). (30) 
From these, the moment can be asymptotically expressed as 

in 



nM 



Til-n) 



nM 



dy e^^(^) (31) 



where 



giy) = -naf3y + J^{y). (32) 

Based on eq. flHT]) . the thermodynamic limit ^(r;,) = limTv^oo log (2'") can be 
assessed by examining the profile of g{y). For the case of P > Pc and a > 1, which we 
currently focus on, x* = e~^=/(l+e~'^=) > Xc = / {l+e~^) is guaranteed. This implies 
that the asymptotic behavior can be classified into two cases depending on whether or 
not yc = e~"'^/(l + e~"'^), which maximizes g{y), is included in the integration range 
y < X*: 

(i) yc < X* 

As yc and x* are parameterized as yc = e~'^^/{l + e""^) and x* = e~^''/(l + e"^"), 
respectively, this holds for n > ric = Pc/P- In this case, g{y) is maximized 
at y = yc, as shown in figure [3l which means eq. ( |3Tll can be assessed as 
(Z^) ~ exp [A^ [giUc) + ?T-a/5/2)]. This yields the thermodynamic limit 

<P{n) = jhn i log (Z") = log 2 + a log (^cosh (^) ) , (33) 

which coincides with (f)RS2{n). 

(ii) ?/c > X* 

This holds for n < ric. Figure [3] indicates that Q{y) is maximized at y = x*, which is 
the right-end point of the integration range. In this case, the asymptotic behavior 
is given as 

^(n) = lim — log (Z") = nap (- - xA tanh ^. (34) 

This is identical to 0irsb(^)- 

The analyticity breaking at n = ric for 0(n) = limN^oo 4>N{n) = 
limAT^oo A^~^ log (^") can be interpreted as follows [TU ^0\. In the low temperature 
phase of P > Pc, it is considered that REM of each sample is dominated by a few 
states of minimum energy. This means that the free energy density in this phase can 
be roughly expressed as —{NP)~~^ log Z ~ A^~^einin, where emin denotes the minimum 
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value of the 2-^ energy states ei, €2, . . . , e2N. The theory of extreme value statistics [T5] 
indicates that y = M~^e^i^ + 1/2, obeys a Gumbel-type distribution, P{y), which in 
the current system is characterized as 

iV^°^^^^^- I (l-a)log2 + a%), 0<y<x*, ^^^^ 

as tends to infinity, where x* = /?.2^^(1 — a^^) represents the typical value of y. The 
physical implication of this behavior is that it is very rare for y to fluctuate in the right 
direction because y is given by the minimum of exponentially many energy values, while 
the fluctuation in the left direction obeys normal-type large deviation statistics described 
by a finite rate function. Eq. (|35|) indicates that if yc < x* holds, which is the case for 
n > Uc, then y = Vc = e~"^/(l+e~"'^), which corresponds to a rare low minimum energy, 
dominates (Z") = Nal3uj~^ J dye~^'^"^yp{y), yielding 0(n) = (j)RS2in). On the other 
hand, for n < ric, {Z"-) is dominated by y = x*, which corresponds to the typical value 
of the minimum energy, and the thermodynamic limit is provided as (f){n) = 0irsb(^)- 
These indicate that the origin of the IRSB solution is a singularity of the distribution of 
the minimum energy, which arises in the thermodynamic limit and is characterized as 
eq. (1351) . The formula (fT2l) makes it possible to more precisely describe the analyticity 
breaking of (f){n) brought about by this singularity. 
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4-2. Numerical assessment of the moment 

The utility of eq. (fT2l) is not limited to analysis in the thermodynamic limit; this formula 
is also useful for the numerical assessment of the moment for systems of finite size. 

A representative approach to evaluate (Z") is to numerically average by 
sampling no, ni, . . . , from eq. (171). This can be efficiently performed as follows 
(also shown in Appendix C of ref. [TO]). 

To generate no,ni, . . . ,nM following eq. (^^, we first sample no from a binomial 
distribution 

where po = P{Eq). For a generated no, we next sample rii from a conditional binomial 
distribution 

where pi = P{Ei)/{l — P{Eq)). We repeat this process up to nM-i', namely, for a 
generated set of rio, ^i, . . . , n^-i, is sampled from a conditional binomial distribution 

P(n,|no,ni,...,n,_i) = y^ , ^p^' (l - p^f -E..o«.^ (38) 

where pi = P{Ei)/{l — Y^k—o P{Ek))- After generating rio, ni, . . . , um-i in this manner, 
nM is given as njv/ = 2^ — ^^Iq ^ n^, which guarantees satisfaction of the strict constraint 

Since each step can be performed by an 0(1) computation, the necessary 
computational cost for this generation is 0{N) per sample, which is feasible. However, 
a problem remains in the evaluation of {Z'"') by this approach based on naive sampling. 

The analysis shown in the preceding subsection indicates that in the low 
temperature phase /? > Pc, {Z"") of n > nc is dominated by samples of a rare low 
minimum energy value in the limit N ^ oo. This implies that accurate assessment of 
such moments requires an exponentially large number of samples since the probability 
of generating the dominant samples decreases exponentially with respect to N. On 
the other hand, the analysis also means that eq. ( |T2|) can be accurately evaluated by 
numerical integration. This is because the integrand of eq. (122|) is practically localized in 
a finite interval due to the properties of large deviation statistics and therefore truncating 
the integration range to a finite interval yields little numerical error. 

Figure H] shows a comparison of the numerical evaluation of (Z^) between the 
sampling and numerical integration approaches for the low temperature phase of 
a = 2, f3 = 3f3c- In both approaches the system size was set to = 10 while the number 
of samples was varied as ACampies = 10, 10^ and 10^. The figure shows that as n increases, 
more samples are necessary to accurately evaluate {Z"'). This is consistent with the 
analysis in the preceding subsection indicating that (2^") for n^nc is dominated by 
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Figure 4. {Z") assessed by numerical integration of eq. p^ and a naive sampling 
scheme for N = 10. The relevant parameters are a — 2 and (3 — 3/3c, which corresponds 
to the low temperature phase. 



samples of a rare low minimum energy. In the sampling approach, ACampics = 10^ 
achieves an accuracy similar to that of the numerical integration. However, more samples 
are necessary as increases because the probability of generating samples that dominate 
(Z") decreases exponentially with A^. On the other hand, the necessary computational 
cost for evaluating {Z"') is not greatly dependent on N in the numerical integration, 
demonstrating a point of superiority of eq. (fT2|) . 

Notice that eq. ( fT2l) holds not only for n G M but also for n G C. This can be used 
for characterizing the breaking of the analyticity of {Z'"') by the convergence of the zeros 
of {Z"") to the real axis on the complex n plane as tends to infinity, which is analogous 
to a description of phase transitions by Lee and Yang [16] and Fisher [I7j . As far as the 
authors know, the complex zeros with respect to n have little been examined except for 
a few examples flEl [T9] although zeros of the complex temperature or external field for 
typical samples of REMs were studied in preceding literature |8l[20]. A detailed analysis 
along this direction will be reported in a subsequent paper [2T] . 

5. Summary 

In summary, we have developed an exact expression for the moment of the partition 
function of CDREM. The expression is valid not only in the thermodynamic limit but 
also for systems of finite size. This is useful for investigating the breaking of analyticity 
with respect to the replica number, which plays the role of the power of the moment, in 
the thermodynamic limit. Our approach demonstrates that the analyticity breaking due 
to a singularity in the distribution of the minimum energy is the origin of IRSB observed 
in the low temperature phase of CDREM. We have also shown that the developed 
expression is useful for numerically evaluating the moment of finite size systems. 

Although the uniqueness of analytical continuation from n G N to n G C is not 
guaranteed by Carlson's theorem for generic REMs, the behavior predicted by our 



Analytic properties of random energy models I: moment of the partition function 14 



approach is qualitatively the same as that of CDREM. This implies that IRSB observed 
in a wide class of REMs originates from the analyticity breaking with respect to the 
replica number n, which takes place in the thermodynamic limit N ^ oo after analytical 
continuation from n G N to n G C is performed for finite A^. 
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Appendix A. Exact expression of {Z"') for continuous random energy model 

We here provide an exact expression of (Z") for the continuous random energy model, 
which was originally introduced by Derrida in In this model, 2^ states are 

distributed in energy E with the following probability. 

The moment of the partition function Z{{Ei}) = ^^^i exp {—j3Ei) is expressed as 

= dE.nEi)^ m}) . (A.2) 

Applying eq. © to {{Ei}) yields 



2iv 

T{-n) Jh \J-oo 



1 



Ti-n) 



H \J-oo 



^ ^ dp{-p)—' ( r -^Le-i^^-^-P^-^^) ) . (A.3) 



Ti-n) Jh \J-oo vGd^ 

Numerically evaluating this is computationally feasible for VA^. 

Deforming the contour H to H : oo + ie ^ +ie — ie — oo — ie with an infinitesimal 
number e (putting p = re^^^~'^\ 9 = — 7r,7r), in conjunction with p > Re(?T,) times 
employment of the integration by parts for removing the singularity at p = 0, yields 

{Z"\ = — / dr rP-"-i 



x(-#yfr j^ e-il^— P(-^^)V , (A.4) 



which is equivalent to eq. (7) of ref. [I2j|. 



Analytic properties of random energy models I: moment of the partition function 15 



From eq. (lA.2p . the behavior of the moment in the thermodynamic hmit can be 
investigated in a manner similar to the analysis of CDREM. This investigation indicates 
that the moment behaves as 

Mn) = Mm 1 log iZ") = | '"f t"'''«'^7,t\ " " (^-5) 

^ N^ooN ' I n(log2 + /?2jV4), n<nRs, 

for j3 < I3c = 2A/Iog2/J in the thermodynamic limit, where n^s = Pll f3'^ > 1- On the 
other hand, 

0H= hm llog(n = ^°f2 + n^'^'/^' (A.6) 
holds for /3 > Pc, where ric = Pc/ P < 1- 

2iv 

The inequality Z {{Ei}) = ^j=iexp {—PEi) > exp {—PEi) gives 

(Z")^/^ > {e-^PE^Y"" = exp (n2/32jV4) , (A.7) 

for n > 0, implying that (Z")^^^ is not upper-bounded by e'^'"'. This means that the 
uniqueness of the analytical continuation from n G M to n G C (Re{n) > 0) is not 
guaranteed by Carlson's theorem for 0Ar(n) = A^~^ log (Z") in the continuous random 
energy model. However, RM successfully reproduces the behavior of eqs. (lA.SP and 
(IA.6p . This implies that the transitions (f){n) = limTv^oo 0Af(^) between the multiple 
solutions that arise in RM, including the IRSB transition, are not due to multiple 
varieties of analytical continuation, but are brought about by the breaking of analyticity 
with respect to the replica number n in a family of REMs. 



Appendix B. Replica analysis of CDREM 

We here show how 0rsi(?t-), 4>RS2{n) and (pmsBin) are derived for CDREM by the replica 
method (RM). In order to evaluate {Z'^) for n G M (or n G C), in RM the moment is 
first evaluated for n G N, for which the power series expansion can be used. This yields 
the expression 

{n = ((j:e-A)= E (e-/^S--») (B.l) 

\ \A=1 J I Ai,A2,...,A„ 

n 

= >v(pi,P2,...,p„)n(W)r, (B.2) 

(pi ,P2,. 

where 

/(/5) = 5^P(E)e-^^~exp 

E 

and W (pi,p2; • • • ;Pn) reprcscuts the number of ways of partitioning n replicas 
Ai, ^2, An to pi states (out oi A = 1, 2, ... , 2^) by one, to p2 states by two, . . ., and 
to Pn states by n. Clearly, W {pi,P2, ■ ■ ■ ,Pn) = unless J2k=i = n. 



Na 



(^og l^cosh 



(B.3) 
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Eq. (1B.3P indicates that each term in eq. (1B.2P scales exponentially with respect to 
N since W {pi,p2, ■ ■ ■ ,Pn) depends exponentially on as well. On the other hand, 
the number of varieties of partition {pi,p2, . . . ,Pn) does not depend on A^. This 
implies that the summation of eq. (]B.2p is dominated by a single term labeled by a 
certain partition {pl,P2, ■ ■ ■ ,Pn) and the exponent 0(n) = limTv^oo N~'^ log (Z") can be 
accurately evaluated by only the single dominant term. Namely, {pi,p2, ■ . . ,Pn) plays 
the role of a replica order parameter. It is noteworthy that this role is similar to that of 
the types in information theory. However, there is a distinct difference between the two 
notions because {pi,P2, ■ ■ ■ ,Pn) represents relative positions of replicas in the replicated 
system while the types are defined for a single system. 

The remaining problem is how to find the dominant partition. Replica symmetry, 
which implies that eq. ( ]B.1|) is invariant under any permutation of replica indices 
a = 1,2, ...,n, offers a useful guideline for solving this problem. This leads to a 
physically natural assumption that the dominant partition is characterized by this 
symmetry as well, which yields the following two RS solutions: 



RSI: Dominated by {pl,P2, 



1 Pn 



(n, 0, ...,0), giving 



exp 



A^n log 2 + a 



This gives limiv-+oo N log (Z") = 
RS2: Dominated by {Pi, pi, ■ ■ ■ , pI 
(Z") ~ 2^ X I{n[3) 
~ exp 



5rsiW- 
= (0,0, 



log l^cosh 



1), giving 



(B.4) 



log2 + a 



log ( cosh 



(B.5) 



This gives limTv^oo N ^ log (Z") = 0rs2(^)- 

Eqs. f lB.4|) and (]B.5|) indicate that 0rsi('^) and 0rs2('^) can be analytically 
continued from n G N to G M (or ?7, G C), respectively. The above equations also 
mean that 0rsi('^) and 0rs2(^) agree at n = 1 in general, which makes it difficult 
to choose the relevant solution for n < 1. As a practical solution, we select, as the 
relevant solution in this region, the solution with the larger first derivative, following 
an empirical criterion given in ref. [10]. This gives 0(n) = 0rsi('^) for (3 < f3c, while 
(f){n) = 4>B.s2{n) is chosen for /5 > /3c. However, in the latter case, 4>RS2{n) is inadequate 
for n < ric = [3c/ (3 < 1 because the convexity condition (d/dn) (^~"'^0rs2(^)) > is 
not satisfied. Therefore, we have to construct another solution taking the breaking of 
replica symmetry into account, which yields the IRSB solution: 

• IRSB: Dominated by p^ = n/m for a certain m and pi = for k ^ m, giving 

(Z") ~ 2^"/" X (/(m/3))"/^'" 



exp 



A^- 



n 



m 



log 2 + a ( log I cosh 



m(3 



(B.6) 
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After analytical continuation, m is determined so as to extremize the right hand 
side, which leads to m = = (3c/ 13. It may be noteworthy that the extremum 
means not maximum but minimum. This gives limAr^oo A^~^ log (2'") = ipmsBin). 

Figure [2] schematically shows the profiles of the three solutions. 
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